An environment for studying the impact of spatialising sonified graphs on data comprehension

We describe AudioCave, an environment for exploring the impact of spatialising sonified graphs on a set of numerical data comprehension tasks. Its design builds on findings regarding the effectiveness of sonified graphs for numerical data overview and discovery by visually impaired and blind students. We demonstrate its use as a test bed for comparing the approach of accessing a single sonified numerical datum at a time to one where multiple sonified numerical data can be accessed concurrently. Results from this experiment show that concurrent access facilitates the tackling of our set multivariate data comprehension tasks. AudioCave also demonstrates how the spatialisation of the sonified graphs provides opportunities for sharing the representation. We present two experiments investigating users solving set data comprehension tasks collaboratively by sharing the data representation

A generic approach for augmenting tactile diagrams with spatial non-speech sounds

Blind or visually impaired users typically access diagrams in the tactile medium. This paper describes TouchMelody, a system designed for augmenting such existing diagrams with 3D spatial auditory information to increase their usefulness, information content and reduce tactile clutter. The motivation for this system, an overview of its development and early experiences are presented. The two major technologies used are the Polhemus FASTRAK and the LakeDSP CP4 to facilitate the creation of a directly manipulated dynamic 3D spatial soundscape

Exploring computer-generated line graphs through virtual touch

This paper describes the development and evaluation of a haptic interface designed to provide access to line graphs for blind or visually impaired people. Computer-generated line graphs can be felt by users through the sense of touch produced by a PHANToM force feedback device. Experiments have been conducted to test the effectiveness of this interface with both sighted and blind people. The results show that sighted and blind people have achieved about 89.95% and 86.83% correct answers respectively in the experiment

Design guidelines for audio presentation of graphs and tables

Audio can be used to make visualisations accessible to blind and visually impaired people. The MultiVis Project has carried out research into suitable methods for presenting graphs and tables to blind people through the use of both speech and non-speech audio. This paper presents guidelines extracted from this research. These guidelines will enable designers to implement visualisation systems for blind and visually impaired users, and will provide a framework for researchers wishing to investigate the audio presentation of more complex visualisations

Constructing sonified haptic line graphs for the blind student: first steps

Line graphs stand as an established information visualisation and analysis technique taught at various levels of difficulty according to standard Mathematics curricula. It has been argued that blind individuals cannot use line graphs as a visualisation and analytic tool because they currently primarily exist in the visual medium. The research described in this paper aims at making line graphs accessible to blind students through auditory and haptic media. We describe (1) our design space for representing line graphs, (2) the technology we use to develop our prototypes and (3) the insights from our preliminary work

Web-based multimodal graphs for visually impaired people

This paper describes the development and evaluation of Web-based multimodal graphs designed for visually impaired and blind people. The information in the graphs is conveyed to visually impaired people through haptic and audio channels. The motivation of this work is to address problems faced by visually impaired people in accessing graphical information on the Internet, particularly the common types of graphs for data visualization. In our work, line graphs, bar charts and pie charts are accessible through a force feedback device, the Logitech WingMan Force Feedback Mouse. Pre-recorded sound files are used to represent graph contents to users. In order to test the usability of the developed Web graphs, an evaluation was conducted with bar charts as the experimental platform. The results showed that the participants could successfully use the haptic and audio features to extract information from the Web graphs

Do Localised Auditory Cues in Group Drawing Environments Matter?

Presented at 5th International Conference on Auditory Display (ICAD), Glasgow, UK, November 1-4, 1998.In this paper, we present the design rationale for a group drawing tool exploiting localised auditory cues to describe user activities. Our hypothesis is that these cues are important for two reasons. Firstly, they make participants aware of the details of execution of peer activities. This is especially significant when these activities are out of visual focus. Secondly, they convey intentionality information among participants. The later has been found to influence significantly inter-participant conversations during real world collaborative drawing activities. Our approach for adding sounds to the group drawing environment involves associating localised auditory messages to the palette, tools, primitive drawing objects and cursors representing metaphoric hands or points of gaze. These mappings give rise to dynamic soundscapes describing operations being or intended to be performed. We discuss the auditory authoring and browsing techniques involved in our group drawing environment together with their implications for the design of future collaborative environments involving auditory ecologie